A New Fast Mode Decision Method for H.264/AVC Intra Coding

In this paper a new fast mode decision method for H.264 /AVC intra coding is developed, which is based on the analysis of edge filter and more efficient mode selection. We analysis the edge detection algorithm from the perspective of edge filters and make it more efficient at mode selecting. In the proposed edge filters, differ from those existing methods which select several neighbor modes only by one filter, we set filters for each directional mode to eliminate the defect of dependency among them. Then the filters are applied to some pixels distributed in the block. The resultant results along with prediction residuals of these pixels are summed for fast mode decision. Besides this, local information has been taken into account by using Most Probable Mode (MPM) from neighbor coded blocks which can significantly mitigate the coding bits increase. Experimental results demonstrate that the proposed method is able to provide a better coding performance than the existing algorithms.